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^rj Abstract 

This paper considers a general Gaussian relay network where a source transmits a message to a 

destination with the help of N half-duplex relays. It proves that the information theoretic cut-set upper 

bound to the capacity can be achieved to within 2.021(/V + 2) bits with noisy network coding, thereby 

c/2 reducing the previously known gap. Further improved gap results are presented for more structured 

networks like diamond networks. 

It is then shown that the generalized Degrees -of- Freedom of a general Gaussian half-duplex relay 
> 

network is the solution of a linear program, where the coefficients of the linear inequality constraints are 

r- — proved to be the solution of several linear programs, known in graph theory as the assignment problem, 

i for which efficient numerical algorithms exist. The optimal schedule, that is, the optimal value of the 

2^ possible transmit-receive configurations/states for the relays, is investigated and known results for 



m 

> 

X 



diamond networks are extended to general relay networks. It is shown, for the case of 2 relays, that only 
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3 out of the 4 possible states have strictly positive probability. Extensive experimental results show that, 
for a general TV-relay network with N < 8, the optimal schedule has at most N + 1 states with strictly 
positive probability. As an extension of a conjecture presented for diamond networks, it is conjectured 
that this result holds for any HD relay network and any number of relays. 

Finally, a 2-relay network is studied to determine the channel conditions under which selecting the 
best relay is not optimal, and to highlight the nature of the rate gain due to multiple relays. 

Index Terms 

Relay networks, Generalized Degrees-of-Freedom, Capacity to within a constant gap, Inner bound, 
Outer bound, Half-duplex, Assignment Problem, Weighted Bipartite Matching Problem. 

I. Introduction 

Cooperation between nodes in a network has been proposed as a potential and promising 
technique to enhance the performance of wireless systems in terms of coverage, throughput, 
network generalized Degrees-of-Freedom (gDoF) and robustness / diversity. This last point is 
of great importance, especially in military and satellite communications, where redundancy and 
diversity play a significant role, by insuring a more reliable link between two networks (military 
communication) and two ground stations (satellite communication), with respect to the point-to- 
point communication. 

The simplest form of collaboration can be modeled as a Relay Channel (RC) [2]. The RC 
is a multi-terminal network where a source conveys information to a destination with the help 
of one relay. The relay has no own data to send and its only purpose is to assist the source in 
the transmission. Motivated by the undeniable practical importance of the RC, in this paper we 
analyze a system where the communication between a source and a destination is assisted by 
multiple relays. In particular, we mainly focus on the enhancement in terms of gDoF due to the 
use of multiple Half-Duplex (HD) relays. A relay is said to work in HD mode if at any time / 
frequency instant it can not simultaneously transmit and receive. The HD modeling assumption is 
at present more practical than the Full-Duplex (FD) one. This is so because practical restrictions 
arise when a node can simultaneously transmit and receive, such as for example how well 
self- interference can be canceled, making the implementation of FD relays challenging 0, flU. 
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A. Related Work 

The RC model was first introduced by van der Meulen [5] in 1971. Despite the significant 
research efforts, the capacity of the general RC is still unknown. In their seminal work [0, Cover 
and El Gamal proposed a general outer bound, now known as the max-flow min-cut outer bound 
or cut-set for short, and two achievable schemes: decode-and-forward (DF) and compress-and- 
forward (CF). The cut-set outer bound was shown to be tight for the degraded RC, the reversely 
degraded RC and the semi-deterministic RC [2J, but it is not tight in general JH. 

Although more study has been conducted for FD relays, there are some important references 
threating HD ones. In Q, the author studied the time-division duplexing RC. Both an outer 
bound, based on the cut- set argument, and an inner bound, based on partial decode-and-forward 
(PDF) were developed. In 0, the time instants where the relay switches from listen to transmit 
and vice versa are assumed fixed, i.e., a priori known by all nodes; we refer to this mode 
of operation as deterministic switch. In [8], it was shown that higher rates can be achieved by 
considering a random switch at the relay. In this way the randomness that lies into the switch may 
be used to transmit (at most one bit per channel use of) further information to the destination. In 
BU, it was also shown how the memory less FD framework incorporates the HD one as a special 
case, and as such there is no need to develop a separate theory for networks with HD relays. 

The pioneering work of [2] has been extended to networks with multiple relays. In [0, the 
authors proposed several inner and outer bounds for FD relay networks as a generalization of 
DF, CF and the cut-set bound; it was shown that DF achieves the ergodic capacity of a wireless 
Gaussian network with phase fading if phase information is locally available and the relays are 
close to the source node. 

The exact characterization of the capacity region of a general memoryless network is chal- 
lenging. Recently it has been advocated that progress can be made towards understanding the 
capacity by showing that achievable strategies are provably close to (easily computable) outer 
bounds [10]. As an example, in [fTTTl . the authors studied FD Gaussian relay networks with 
iV + 2 nodes (i.e., N relays, a source and a destination) and showed that the capacity can 
be achieved to within Ylk=i 5min{M fc , N k } bits with a network generalization of CF named 
quantize-remap-and-forward (QMF), where M k and Nk are the number of transmit and receive 
antennas, respectively, of node k. Interestingly, the gap result remains valid for static and ergodic 

June 3, 2013 DRAFT 



fading networks where the nodes operate either in FD mode or in HD mode; however IfTTTl did 
not account for random switch in the outer bound. In [12J, the authors demonstrated that the 
QMF scheme can be realized with nested lattice codes. Moreover they showed that for single 
antenna HD networks with iV relays, by following the approach of [8|, i.e., by also accounting 
for random switch in the outer bound, the gap is 5iV bits. Recently, for single antenna networks 
with N FD relays, the 5(iV + 2) bits gap of 0U was reduced to 2 x 0.63(iV + 2) bits (where 
the factor 2 accounts for complex-valued inputs) thanks to a novel ingenious generalization of 
CF named noisy network coding (NNC) lfT3ll . 

The gap characterization of [[131 is valid for a general Gaussian network with FD relays; the 
gap grows linearly with the number of nodes in the network, which could be a too coarse capacity 
characterization for networks with a large number of nodes. Smaller gaps can be obtained for 
more structured networks. For example, a diamond network [fl4][ consists of a source, a destination 
and N relays where the source and the destination can not communicate directly and the relays 
can not communicate among themselves. In other words, a general Gaussian relay network with 
N relays is characterized by (iV + 2)(iV+ 1) generic channel links, while a diamond network has 
only 2iV non-zero channel links. In [14J the case of N = 2 relays was studied and an achievable 
region based on time sharing between DF and amplify -and-forward (AF) was proposed. The 
capacity of a general FD diamond network is known to within 21og(iV + 1) bits [fT5l . If, in 
addition, the FD diamond network is symmetric, that is, all source-relay links are equal and all 
relay-destination links are equal, the gap is less than 2 bits for any N [16]. 

HD diamond networks have been studied as well. In a HD diamond network with N relays, 
there are 2 N possible combinations of listening / transmitting states, since each relay, at a given 
time instant, can either transmit or receive. For the case of iV = 2 relays, [fT7] showed that out 
of 2 N = 4 possible states only N + 1 = 3 states suffice to achieve the cut-set upper bound to 
within less than 4 bits; we refer to the states with strictly positive probability as active states. 
The achievable scheme of ifTTl is a clever extension of the two-hop DF strategy of [18]. In ifTTll 
a closed-form expression for the aforementioned active states, by assuming no power control 
and deterministic switch, was derived by solving the dual linear program (LP) associated with 
the LP derived from the cut-set upper bound. The work in []T9l considered a general diamond 
network with N = 2 relays and an 'antisymmetric' diamond network with N = 3 relays and 
showed that a significant fraction of the capacity can be achieved by: (i) selecting a single relay, 
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or (ii) selecting two relays and allowing them to work in a complementary fashion as in [17J. 
Inspired by [17J, the authors of [19] also showed that, for a specific HD diamond network with 
N = 3 relays, at most iV + 1 = 4 states out of the 2 N = 8 possible ones are active. The authors 
also numerically verified that for a general HD diamond network with N < 7 relays, at most 
N + I states are active and conjectured that the same holds for any number of relays. 

Relay networks were also studied in ll20ll . where an iterative algorithm was proposed to 
determine the optimal fraction of time each HD relay transmits/receives by using DF under 
deterministic switching mechanism. 

B. Contributions 

In this work we study a general Gaussian HD relay network, whose exact capacity is unknown, 
by following the approach proposed in [H]. Our main contributions can be summarized as follows: 

1) We prove that NNC is optimal to within 2.021 (JV + 2) bits. This gap is smaller than the 
5iV bits gap available in the literature ifTOl . [TT2l for any N > 2. We also show that the new 
gap for the HD relay network may be further decreased by considering more structured 
systems, such as the diamond network, for which the gap is of order N. 

2) The bounding technique we use is tighter than the one proposed in [13] and, as a by-product 
of our approach, we reduce the gap for a general multicast complex- valued Gaussian FD 
network with K nodes from 1.26K bits to 1.021K bits. 

3) In order to determine the gDoF of the channel, one needs to find a tight high-SNR 
approximation for the different mutual information terms involved in the cut-set upper 
bound. As a result of independent interest, we show that such tight approximations can 
be found as the solution of Maximum Weighted Bipartite Matching (MWBM) problems, 
or assignment problems ETTl . The MWBM problem is a special LP for which efficient 
polynomial-time algorithms, such as the Hungarian algorithm [22J, exist. Although not 
explored here, this technique may be useful in solving other similar problems such as that 
of finding the gDoF of a general Multiple-Input-Multiple-Output (MIMO) system. 

4) We extend the results of ifTTTl from a 2-relay diamond network to a general 2-relay 
network and we show that, out of the 2^ = 4 possible states, at most N + 1 = 3 are 
active. Similarly to the HD diamond network studied in [19], we verify through extensive 
numerical evaluations that, for a general relay network with N < 8 relays, at most N + 1 

June 3, 2013 DRAFT 



states are active. Based on this evidence, we conjecture that the conjecture of [19] holds 
for any HD relay network. 
5) We finally consider a general relay network with N = 2 relays. We highlight under which 
channel conditions a best-relay selection scheme is strictly suboptimal in terms of gDoF 
and we gain insight into the nature of the rate gain attainable in networks with multiple 
relays. For example, we show when the interaction between the relays, which is impossible 
in diamond networks, increases the gDoF. 

C. Paper Organization 

The rest of the paper is organized as follows. Section [n] describes the channel model and 
defines the gDoF and the notion of capacity to within a constant gap. Section [Hi] shows that the 
cut-set upper bound and the NNC lower bound for a general Gaussian HD relay network are to 



within a constant gap from each another. Section IV proves the equivalence between the problem 



of finding the coefficients of the linear inequality constraints of the LP derived from the cut-set 
upper bound and the MWBM problem; it also shows that, for a 2-relay network, the number of 
active states in the cut-set upper bound is at most 3; it finally presents a conjecture regarding the 
maximum number of active states sufficient to characterize the cut-set upper bound for a general 
relay network and for any number of relays. Section [V] provides an example of a HD relay 
network with N = 2 relays; it determines under which channel conditions the gDoF achieved 
with the best-relay selection strategy is strictly smaller than the gDoF attained by exploiting 



both relays; it provides insights into the synergies of multiple relays. Section [VI] concludes the 
paper. 

Notation 

We use the notation convention of [|23l : [n\ : n 2 ] is the set of integers from n% to n 2 > n 1 , 
[x] + : = max{0, x} for x 6 IR; Y^ is a vector of length j with components (Y 1 , . . . , Yj); for an 
index set A we let Y4 = {Yj : j E A}; Oj is a column vector of length j of all zeros; lj is a 
column vector of length j of all ones; lj is the identity matrix of dimension j; fi(x) = J2{x) 
means that lirn^oo fi(x)/f 2 (x) = 1. \A\ indicates the determinant of the matrix A or the 
cardinality of the set A, which one is usually clear from the context, while ||o|| is the Euclidean 
length of the vector a. To indicate a sub matrix of the matrix A where only the rows indexed 
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by the set 1Z and the columns indexed by the set C are retained, we use the Matlab-inspired 
notation A^c- Moreover, for a square matrix A, diag[A] is a vector containing the diagonal 
elements of A, while for a vector a, diag[a] is a diagonal square matrix with the elements of 
a on the main diagonal. X ~ J\f (fi,a 2 ) indicates that X is a proper-complex random variable 
distributed normally with mean \x and variance a 2 . 

II. System model 

A. General memoryless relay network 

A memoryless relay network has one source (node 0), one destination (node N + 1), and N 
relays indexed from 1 to N. It consists of N + 1 input alphabets (X 1: ■ ■ ■ , X N) X N+1 ) (here X { 
is the input alphabet of node i except for the source/node where, for notation convenience, we 
use X N+ i rather than X ), N + 1 output alphabets (y 1 , ■ ■ ■ , y N , 3^v+i) (here 3^ is the output 
alphabet of node i), and a transition probability Py [1 . JV+1] |x [1]V+ir The source has a message W 
uniformly distributed on [1 : 2 nR ] for the destination, where n denotes the codeword length and 
R the transmission rate in bits per channel use (logarithms are in base 2). At time i, i E [1 : n], 
the source maps its message W into a channel input symbol X N+ i^ (W), and the £>th relay, 
k E [1 : N], maps its past channel observations into a channel input symbol X kyi (Y£~ ). The 
channel is assumed to be memoryless, that is, the following Markov chain holds for all % E [1 : n] 

( W ' Y [1:N+1]' X [1:N+1]) ~* -^"[l:iV+l],i ~> ^l:JV+l],i- 

At time n, the destination outputs an estimate of the message based on all its channel observations 
as W (Yj} +1 ). The capacity is the largest nonnegative rate such that P(W^ jy] — > as n— >+oo. 
In this general memoryless framework, each relay can listen and transmit at the same time, 
i.e., it is a FD node. HD channels are a special case of the memoryless FD framework in the 
following sense [8J. With a slight abuse of notation compared to the previous paragraph, we 
let the channel input of the £>th relay, k E [1 : N], be the pair (Xk,Sk), where Xk E Xk as 
before and Sk E {0, 1} is the state random variable that indicates whether the A;-th relay is in 
receive-mode (S k = 0) or in transmit-mode (S k = 1). In the HD case the transition probability 
is specified as Py [1:]V+1] |x [1 ^ +1] ,s [1:]vr 
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Y = H cq X + Z, 








H cq := 


I at - diag[S] 


Otv 

1 


H 


diag[S] Oat 
_ 0£ 1 



B. The Gaussian HD relay network 

The single-antenna complex- valued power-constrained Gaussian HD relay network is described 
by the input/output relationship 

(la) 

(lb) 
0^ lj [ 0^ lj 

where 

• Y := [y" 1? . . . , Y N , Y N+1 ] T E C N+1 is the vector of the received signals. 

. X := [Xi, . . . ,Xn,Xn + i] t E C n+1 is the vector of the transmitted signals (recall that, 
although the source is referred to as node 0, its input is indicated as X^+i rather than X ). 
Without loss of generality, we assume that the channel inputs are subject to the average 
power constraint E [|X fc | 2 ] < 1, k € [1 : N + 1]. 

• S := [Si, . . . , Sn] E {0, 1}^ is the vector of the binary relay states, which takes into account 
if the A;-th relay is receiving (Sk = 0) or transmitting (Sk = 1) for k E [1 : N], 

• HE £.( n + 1 ) x ( n + 1 ) i s the constant channel matrix known by all terminals defined as 

jrx r _j. r Jn s _^ r 

H r _Ki H s ^.d 
The entry in position (i,j) of the channel matrix in ([2]) represents the channel from node 
j to node i, (i,j) E [1 : N + l] 2 , in particular: 

- H r ^ r E C NxN defines the network connections among relays, i.e., [H r ^ r ]^, (i,j) E 
[1 : N} 2 , is the channel gain from the j-th relay to the i-th relay. Notice that the entries 
on the main diagonal of H r _» r do not matter for channel capacity, since the £>th relay, 
k E [1 : N] can remove the 'self- interference' X k from Y k . 

- H B _>. r E C Nxl is the column vector which contains the channel gains from the source 
to the relays, i.e., [H s ^. r ]ji, i E [1 : N], is the channel gain from the source to the i-th 
relay; 

- H r ^d E C lxN is the row vector which contains the channel gains from the relays to 
the destination, i.e., [Hr^d]^, i E [I : N], is the channel gain from the i-th relay to 
the destination; 



H:= 



(2) 
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- H s _> d G C lxl is the channel gain between the source and the destination (recall that by 
our notation the source input is indicated as Xjv+i rather than X ). 
• Z := [Zi, . . . , Zn, Zn + i] t G C n+1 is the jointly Gaussian noise vector. Without loss 
of generality, the noises are assumed to have zero mean and unit variance. Furthermore 
we assume, not without loss of generality Il24l . that the noises are independent, i.e., the 
covariance of Z is the identity matrix. 
The capacity of the Gaussian HD relay network in ([T]) is not known in general. In order to 
evaluate the ultimate performance of this system we make use of two metrics: the gDoF and the 
capacity to within a constant gap. The capacity to within a constant gap is defined as: 

Definition 1. The capacity C of the Gaussian HD relay network in ([T|) is said to be known to 
within GAP bits if one can show an achievable rate R^ m ' and an outer bound i?( out ) such that 

R {in) < C < R (out) < R {in) + GAP, (3) 

where GAP is a constant that does not depend on the channel gain matrix H in ([T]). 

Knowing the capacity to within a constant gap implies the exact knowledge of the gDoF 
defined as: 

Definition 2. The gDoF of the Gaussian HD relay network in ([T]) is defined as 

C 

d : = lim / ^tt^v, (4) 

SNR^+oo log(l + SNR) 

where C is the capacity and SNR G IR + parameterizes the channel gains as \hij\ 2 = SNP\ J , for 
some non-negative fy, (i,j) G [1 : N + l] 2 . 

The gDoF in Q is an exact characterization of the capacity at high-SNR, while the capacity 
to within a constant gap in ^ quantifies how far inner and outer bounds are in the worst SNR 
scenario. 

III. Capacity to within a constant gap 

This section is devoted to the capacity characterization of the Gaussian HD relay network 
in Q to within a constant gap. To accomplish this, we first adapt the cut-set upper bound [|9l 
and the NNC lower bound [fT3l to the HD case by following the approach proposed in J5]|. Then 
we show that these bounds are at most a constant number of bits apart. Our result is: 
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Theorem 1. The cut-set upper bound for the HD relay network with N relays is achievable to 
within 

GAP < 2.021(iV + 2) bits, (5) 

by using as achievable scheme NNC with deterministic switch. 

Proof: Here we prove a general gap result for multicast single- antenna complex- valued 
power-constrained Gaussian HD networks in the spirit of [fT3l Theorem 4]. The channel model 



is defined as in the Section II-B except that each node k E [1 : K] has an independent message 
of rate Rk for the nodes indexed by V ^ so that the channel input/output relationship reads 
Y = (I K — S) H S X + Z. The gap for a HD relay network with iV relays is a special case of 
this setup for K = N + 2. 

The capacity of a HD Gaussian multicast network can be lower bounded by adapting the 
NNC scheme for the general memory less network |fT3l to the HD case by following |[S]|. For 
each AC[1: K]\0 and such that i c flD/|, similarly to [13, eq.(20)], the NNC lower bound 
gives 



/ jRj > I{Xa]Yaz\Xa c ,S\v.k\) — I(Xa',Ya\Ya c , X[i..k], S{i;K}) 

ieA 

>Y,\ S log I m + -^- 2 H As Hj s - \A\ log (l + ±\ , (6) 

where X s := F[S [1:K] = s] E [0,1], Vs E [1 : 2 K ] : E^=i A « = 1. where " 5 [i^] = s " is a 
shorthand notation for Sh.,K] = [Si,--- ,Sk] where Sk E [0 : 1], VA; E [1 : K], are such that 
s = l + J2*=i S k% K ~ k (for example "S [1:5] = 8" means S [1:5] =[S 1 ,...,S S ] = [0, 0, 1, 1, 1] since 
8-1 = 0-2 4 + 0-2 3 + l-2 2 + l-2 1 + l-2°; similarly diag[s]| s=8 = diag[[0, 0,1, 1,1]]). The matrix 
Ha,s is defined as Ha,s '■= [(Ir- — diag[s]) H diag[s]]^ c .. In all states s E [1 : 2 K ], we consider 
i.i.d. Af (0, 1) inputs, time sharing random variable Q set to Q = Su-jn (with this choice the 
nodes can coordinate), and compressed output Yj. := Y& + Z\~, k E [1 : K], for Zk ~ A/"(0,a 2 ) 
independent of all other random variables (note that the variance of Zk does not depend on the 
user index k). 
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The cut-set upper bound in [9] adapted to the HD case [8] gives, similarly to [Q~3l eq.(19)], 



ieA 



< I(Sx, Ya c ) + I{Xa\ Yj[c\X A c 7 S[i:K]) 

< H{S A ) + Y, X s log |l m + EU, s K As H 



H I 

As 



(a) 



< |^|log(2) + ^A, log 



8=1 



Iu c i + ~ ^H^ S H, 



*-\a°\ 



(b) 



1 + a 2 

1 + C7 2 

1 



A» n A. 



1*41 



+ g A s Rank[H As ] log [e max 1 1, — - ^-^ 

2 K 

< |.A|log(2) + £)A. log 

8=1 

+min{|.4.|, |^4 c |}log ( emax <> 1, 



M,sJ 



Iu c i + " nHi «H 



L|^| 



1 + a 2 " 
1 + a 2 



M,s-n_4 



\A\ 



iin< 



l+j- 2 min{|.4|, 



-A c |} | 



(7) 



e min{|.A|,|.A c |} 

for all AC [1 : K]\® and such that A c H £> 7^ (see JT3l eq.(4)]), where K^ represents 
the covariance matrix of X4 conditioned on S\i : k] = s. The inequality in (a) follows since the 
entropy of a random variable can be upper bounded with the support of the variable and by using 
lfT3l Lemma 1] for some a 2 > e — 2. The inequality in (b) is due to the fact that the function is 
increasing with respect to the rank of the channel matrix and the rank is upper bounded by the 
minimum between the number of rows and of columns. 

By letting 7 = 1 + a 2 >e — 1 and fi = LI, the gap between the cut-set upper bound in @ 
and the NNC lower bound in (|6]) becomes 



GAP < K I min max <! a log ( 

\7>e-l /KG[0:1] [ W - 1 



+ 



, -ri \ • J 7 min {M -/*}\i ( j 

+ mm \li, 1 — n\ mm < — , > log max < 



7/i 



( c) k ( . r / 2 7 

= — mm < log 

2 V^ - 1 I V7 - 1 



7 
f min <j — , 

e 



min{yU, 1 — fi} 
1 > log ( emax < 1, — > 



(d) 



2.021X bits, 



where the maximum over /j, G [0, 1] is attained at /i opt = | and the minimum over 7 is attained 
at 7° pt = v4c+i+i an( j triese resu its lead to the equalities in (c) and (d), respectively. ■ 
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We observe that the gap in ([5]) improves, for any number of relays greater than one, on the 
previously known gap result of 5iV bits lfT2ll . Moreover: 



Remark 1. The gap result in ^ for N = l gives GAP < 6.0630 bits, which is greater than the 
1.61 bits gap we found for the single relay case in / l25l/ . This is due to the fact that the bounding 
steps in the special case of N = 1 are tighter than those we used here for a general N. 

Note also that for a single relay, PDF is optimal to within 1 bit / f25l/ . However, PDF does 
not seem to be easily extendable to networks with an arbitrary number of relays /|9]/, which is 
the main motivation for considering NNC here. 

Remark 2. In a preliminary version of this work /[/J/, by using a bounding technique as in l\26\ 
pages 20-5, 20-7] we obtained 

GAP = ^^log(4(iV + 2)) bits. (8) 

As shown in Fig. [7J the gap in ([5]) is smaller that the one in ([8]) for N > 2. This is accomplished 
thanks to the tighter bound from / [73] Lemma 1]. 

Remark 3. From £75]/, the gap of a general K-user multicast complex-valued FD Gaussian 
network is (2 x 0.63)fC. However, by using the tighter bound Rank[H_4 )S ] < min{|^4|, |*4 C |}, 
instead o/RankfH^J < \A\, the gap can be reduced to (2 x 0.5105)/^. 

A smaller gap than the one in (|5]) may be obtained by deriving tighter bounds on specific 
network topologies. For example, in lfT5l it was found that for a Gaussian FD diamond network 
with A" relays the gap is of the order \og(N), rather than linear in A^ [fT3l . Moreover, for a 
symmetric FD diamond network with A^ relays the gap does not depend on the number of relays 
and it is upper bounded by 2 bits [16J. The key difference between a general relay network 
and a diamond network is that for each subset A we have Rank[H_4] < 2, i.e., the rank of any 
channel sub-matrix does no longer depend on the cardinality of the index set A. Based on the 
simpler topology of a diamond network we have: 

Proposition 1. The cut-set upper bound for the Gaussian HD diamond network with N relays 
is achievable to within 
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bits. 

Proof: The proof can be found in Appendix |AJ ■ 

When N ^$> 1, the gap in (|9]) can be approximated as GAP = iV bits. As expected, the gap 
in (|9]) for the HD diamond network is in general (for iV > 3) smaller than that in (|5]) computed 
for the general HD relay network; this is in line with what happens in the FD case. However, in 
FD for the diamond network the gap is logarithmic in N [fT5l . while the gap in (|9]) still grows 
linearly with N. This is in part due to the fact that, in the HD outer bound, there is an entropy 
term due to the random switch that is maximized by considering a uniform probability over the 
all possible listen / transmit states that, for the multicast network, are 2 N+2 (see Appendix |a|). 
As we shall see in the next section, for a general HD network with N relays, only N + I 
states, out of the possible 2 N states, appear to be needed to characterize the cut-set upper bound. 
It is subject of current investigation on how to use this observation to develop bounds leading 
to a smaller gap. 

IV. Analysis of the optimal schedule 
In general, for a iV-relay network, 2 N states are possible. A capacity achieving scheme must 



optimize the fraction of time each of these states occurs. In 111711 . it was proved that for a diamond 
network with N = 2 relays, out of the 2 N = A possible states, at most N + 1 = 3 have a non-zero 
probability and are sufficient to characterize the cut-set upper bound, i.e., we say that there are 
N + 1 = 3 active states. In [fl9l . the authors extended the result of [fTTll to a special case of 
diamond network with N = 3 relays; based on numerical evidences, [fl9ll conjectured that for a 
iV-relay diamond network out of the 2 N possible states at most N + 1 states are active. Here we 
extend these results to a general Gaussian HD relay network as follows. The claim "out of 2 N 
possible states only N + 1 states are active as far as gDoF is concerned" is proved analytically 
for N = 2, shown to hold by numerical evaluations for N < 8 and conjectured to hold for any 
N. If the conjecture were true, it would show that HD relay networks have intrinsic properties 
regardless of their topology, i.e., known results for diamond networks are not a consequence of 
the simplified network topology. 

In order to determine the gDoF we must find a tight high-SNR approximation for the different 
MIMO-type mutual information terms involved in the cut-set upper bound (see Section|IlI|eq.(f7|)). 
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As a result of independent interest, besides the application to the Gaussian HD relay network 
studied in this paper, we first show that such an approximation can be found as the solution of 
a Maximum Weighted Bipartite Matching (MWBM) problem. 

A. The maximum weighted bipartite matching (MWBM) problem 

In graph theory, a weighted bipartite graph, or bigraph, is a graph whose vertices can be 
separated into two sets such that each edge in the graph has exactly one endpoint in each set. 
Moreover, a non-negative weight is associated with each edge in the bigraph Il27ll . A matching, 
or independent edge set, is a set of edges without common vertices [27]. The MWBM problem, 
or assignment problem, is defined as a matching where the sum of the edge weights in the 
matching has the maximal value [[211 . The Hungarian algorithm is a polynomial time algorithm 
that efficiently solves the assignment problem [22 J. Equipped with these definitions, we now 
show the following high-SNR approximation of the MIMO capacity: 

Theorem 2. Let H G IR fcxn be a full-rank matrix, where without loss of generality k < n. 
Let S Uj k be the set of all k-combinations of the integers in [1 : n] and V n ,k be the set of all 
k-permutations of the integers in [1 : n]. Then, 

|I fc + HH"|=]T J2 Ill^wl 2 + T = SNR™( B ), (10) 



--SN 



R £ i= l[Bdi,,r(i) 



MWBM(B) := max max £ [BJ^, (11) 






where B is the SNR-exponent matrix defined as [B]y = flij > : \hij\ 2 = SNFv iJ , B ? is the 
square matrix obtained from B by retaining all rows and those columns indexed by s, and T is 
the sum of terms that overall have an exponential behavior that is less than MWBM(B). 



Proof: The proof can be found in Appendix |Bj The expression in ( [TT] ) is a possible way of 
writing the MWBM problem. ■ 

Theorem [2] establishes an interesting connection between the capacity of a MIMO channel 
(with independent inputs) and graph theory. Note that the high-SNR expression found in The- 
orem [2] holds for correlated inputs as well, as long as the average power constraint is a finite 
constant. More importantly, Theorem |2] allows to move from DoF, where all exponents /3y have 
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the same value, to gDoF, where different channel gains have different exponential behavior. DoF 
is essentially a characterization of the rank of the channel matrix; gDoF captures the potential 
advantage due to 'asymmetric' channel gains. gDoF, to the best of our knowledge, has been 
investigated so far only for Single-Input-Single-Output (SISO) networks with very few number 
of nodes; we believe that the reason is that in these cases one has only to consider equivalent 
Multiple-Input-Single-Output (MISO) and Single-Input-Multiple-Output (SIMO) channels, or to 
explicitly deal with determinants of matrices with small dimensions. Our result extends the gDoF 
analysis to any MEMO channel as we explain through some examples: 

1) Case k = 1 < n: In a MISO or SIMO channel, with channel vector h := [hi, . . . , h n ) such 
that \h k \ 2 = SNR & , k e [1 : n], one trivially has 

( n \ SNR>1 , v 

1 + J2 SNR ft = log KNR max ^-]{M J 

The corresponding MWBM problem has one set of vertices A\ consisting of k = \Ai\ = 1 
node and the other set of vertices Ai consisting of n = \A 2 \ > 1 nodes. The weights of the 
edges connecting the single vertex in A\ to the n vertices in 4.2 can be represented as the 
non-negative vector B = [/3 1; . . . , f3 n ]. Clearly, the optimal MWBM(B) = max ie [ 1:n ]{/3j} 
assigns the single vertex in Ai to the vertex in A2 that is connected to it through the edge 
with the maximum weight. 

2) Case k = n = 2: As another example from the 2-user interference channel literature, 
consider the cut-set sum-rate upper bound 11281 

SNR>1 



log(l 2 + HH") = log KNR max{/3l3+/324 ' /323+/3l4} 

SNR A3/2 eJ 013 SNR^ 23 / 2 e j023 
SNR/314/2 ^e 14 SNR^ 24 / 2 e j024 



H:= 



hi3 h 2 3 

hu ^24 



The corresponding MWBM problem has one set of vertices A\ consisting of k = \Ai\ = 2 
nodes (for future references let us refer to these vertices as nodes 1 and 2 - see first 
subscript in the channel gains) and the other set of vertices A2 consisting also of n = 
I .A2 1 =2 nodes (for future references let us refer to these vertices as nodes 3 and 4 - see 
second subscript in the channel gains). The weights of the edges connecting the vertices in 
4.1 to the vertices in 4.2 can be represented as the non-negative weights (3ji, i = 3, 4, j = 
1, 2. In this example, one possible matching assigns node 1 to node 3 and node 2 to node 
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4 (giving total weight /?i 3 + /3 2 4), while the other possible matching assigns node 2 to node 
3 and node 1 to node 4 (giving total weight /3 23 + /3u)', the best assignment is the one that 
gives the largest total weight. 

Notice that the MWBM is a tight approximation of the 2x2 MIMO capacity only when 
the channel matrix is full rank, see Il2~8l eq.(5) 1st line], but it is loose when the channel 
matrix is rank deficient, see ll28l eq.(5) 2nd line, and compare with eq.(ll)]. The reason 
is that the MWBM can not capture the impact of phases in MIMO situations. To exclude 
the case of a rank deficient channel matrix from our general setting for any value of k 
and n, we may proceed as in 11291 page 2925]. Namely, we pose a reasonable distribution, 
such as for example the i.i.d. uniform distribution, on the phases 9ji, i = 3, 4, j = 1,2, 
so that almost surely the channel matrix is full rank. 
3) Case k = 2, n = 3: The MWBM allows to find the high-SNR approximation of any MIMO 
system capacity. As an example, which to the best of our knowledge is not known from 
the literature, consider a full-rank MIMO systems n = 3 transmit antennas and k = 2 

Pll Pl2 Pl3 



receive antennas and with SNR-exponent matrix B = .In this case we 

have 

MWBM(B) = max |/3 n + fa, /3 n + /3 23 , /3 12 + /3 21 , /3 12 + /3 23 , /3 13 + /3 21 , /3 13 + /3 22 }, 

which can also be obtained by tedious direct computation of the limiting value of the 
corresponding log-det formula. 

B. The gDoF for a general N -relay network 

With Theorem [2] we can now express the gDoF d in Q of the Gaussian HD relay network 
in ([!) as a LP. In particular, let 

f T := [0£v,l] (12a) 

x T :=[Ai,...,A 2 *,d], (12b) 
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then 



d = max{f T x} 



s.t. 



A 1 2 jv 


2^x2^ 



J- 2 JV 



x < f , x > 0, 



(12c) 
(12d) 



where the non-negative matrix A G IR has entries (recall that, although the source is 

referred to as node 0, its input is indicated as X^+i rather than X ) 

H^A t U{N+l}',yA c l U{N+l}\XA c l ,S[ 1]N ] = Sj) 



[A] 



tj ■- 



lim 



SNR^+oo log(l + SNR) 

By a simple application of Theorem [2] we have 



(12e) 



Theorem 3. [A] 



i.i 



MWBM(B Ai 



The notation in eq.( |12e[ ) and in Theorem [3] is as follows. B indicates the SNR-exponent matrix 
defined as [B]# = fy > : \hij\ 2 = SNR ftj (defined in @), and the indices (i,j) have the 
following meaning. Index i refers to a "cut" in the network and index j to a "state of the relays". 
Both indices range in [1 : 2^] and must be seen as the decimal representation of a binary number 
with N bits. A%, % E [1 : 2^], is the set of those relays who have a one in the corresponding 
binary representation of % — 1 (example for N = 3: for i — 1 = 6 = 1- 2 2 + l-2 1 + 0-2° we 
have A-j = {1,2} and therefore Aj = {3}). Sj, j E [1 : 2^], sets the state of a relay to the 
corresponding bit in the binary representation of j — 1 (example for N = 3: for j — 1 = 6 we 
have s 7 = [1, 1,0], which means that relays 1 and 2 are transmitting and relay 3 is receiving). 
Finally, 



B 



A, 



Ijv - diag[sj] Ojy 
0^ 1 



H 



diagfsj] Oat 
T N 1 



{N+1}UA^,{N +1}U Ai 

One interesting question is how many \j, i.e., \j is the fraction of time the network is in state 
j E [1 : 2^], are strictly positive [fTTll . [fT9l . In [fTTl . the authors analyzed the diamond network 
with 2 relays and showed that out of the 4 possible states only 3 states are active. The proof 
considers the dual of the LP in ( fi~2~| ). Here we extend the result of [fTTll to the fully-connected 
HD relay network with 2 relays; our proof identifies the channel conditions under which setting 
the probability of one of the states to zero is without loss of optimality. We have: 
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Theorem 4. For a general HD relay network with 2 relays, there exists an optimal schedule 
that optimizes d in ( |12c[ ) with at most 3 active states. 



Proof: The proof can be found in Appendix [Cj which uses the notation in ( [T3| ) where 



a 



.ft 



is the SNR-exponent on the link from the source to relay i, i 6 [1 : 2], au is the SNR-exponent 
on the link from relay i, i 6 [1 : 2], to the destination, /% is the SNR-exponent on the link 
from relay j to relay i, (i, j) G [1 : 2] 2 with j ^ i, and the direct link from the source to the 
destination has SNR-exponent normalized to 1. ■ 

We conjecture that for a general HD relay network with any number of relays Theorem [4] 
continues to hold, similarly to the conjecture presented in |fT9l for the diamond network. Namely: 

Conjecture. For a general HD relay network with N relays, there always exists an optimal 
schedule that maximizes the gDoF with at most N + 1 active states. 

The conjecture holds for the case of 2 relays as proved in Theorem |4} We proceeded through 
the following numerical evaluations: for each value of iV < 8, we generated uniformly at random 



the SNR exponents of the channel gains, we computed the entries of A in ( 12 ) with the Hungarian 



algorithm, we solved the LP in ( fT2| ) with the simplex method and we counted the number of 
constraints that equal the optimal gDoF (which is a known upper bound on the number of non 
zero entries of an optimal solution). The minimum and the maximum number of active states 
were found to be 1 and N + 1, respectively, as shown in Fig. [2j which also shows the average 
number of active states computed by giving an equal weight to all the tried channels. Note that 
the minimum number of active states for a generic HD relay network with A" relays has to be at 
least N + 1. To see this, consider a 'line network' where the source can only communicate with 
relay 1, relay 1 can only communicate with relay 2, etc, and relay A" can only communicate 
with the destination; in a line network, N +1 non-zero states are necessary to enable the source 
to communicate with the destination. It is interesting that the minimum number of active states 
given by A^ + 1 also appears to be the required maximum number of active states for achieving 
the optimal gDoF-wise network operation. If the reduction of the number of active states from 
exponential to linear as conjectured holds, it offers a simpler and more amenable way to design 
the network [19|. 
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V. Fully-connected relay network with N = 2 relays 

To gain insights into how relays are best utilized, we consider a network with N = 2 relays. 
The analysis presented here differs from the one in [19| in the following: (i) we study the fully- 
connected network, while in |[T9ll only the diamond network is treated; (ii) we explicitly find 
under which channel conditions the gDoF performance is enhanced by exploiting both relays 
instead of using only the best one, and (iii) we provide insights into the nature of the rate gain 
in networks with multiple HD relays. 



We consider the parameterization in ( [13] ) where, in order to increase the readability of the 
document, the SNR-exponents are indicated as 



log(|frof) 
Llog(SNR)j ( .. 



7)6[1:3]2 



\ 



* &i a si 

y oiid oi 2 d i I 



(13) 



where * denotes an entry that does not matter for channel capacity (because a relay can remove 
the 'self-interference'), a si is the SNR-exponent on the link from the source to relay i, i E [I : 2], 
aid is the SNR-exponent on the link from relay i, i E [1 : 2], to the destination, /% is the SNR- 
exponent on the link from relay j to relay i, (i,j) E [1 : 2] 2 with j ^ i, and the direct link from 
the source to the destination (entry in position (3,3) in (fl"3])) has SNR-exponent normalized to 
1 without loss of generality. Note that in order to consider a network without a direct link it 
suffices to consider all the other SNR-exponents to be larger than 1, or simply replace '1' with 
'0' in the discussion in the rest of the section. 
We next derive the gDoF in both the FD and HD cases. 



A. The Full-Duplex Case 

For the FD case, the cut-set bound is achievable to within 2 x 0.5105 x 4 = 4.084 bits with 
NNC (see Remark [3]). As a consequence, it can be verified that the gDoF for the FD case is 

d ( N=l = min { max {1, a sl , a s2 } , max {a s2 + a ld , (3 2 + 1} , 

max {a s i + a 2d , /?i + 1} , max {1, a ±d , a 2d } j > 1. (14) 



Notice that the gDoF in ( |T4| ) is no smaller than the gDoF that could be achieved by not using the 
relays, that is, by communicating directly through the direct link to achieve gDoF = 1. Notice 
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also that the gDoF in ( [14] ) does not change if we exchange a s \ with a 2 d and a s2 with aid, i- e -> 
if we swap the role of the source and destination. We aim to identify the channel conditions 
under which using both relays strictly improves the gDoF compared to the best-relay selection 
policy (which includes direct transmission from the source to the destination as a special case) 
that achieves 

d !v=2,best relay = maX {h ™in{a,i, a ld }, min{a! s2 , a 2d }} € [Ma3]" (15) 

We distinguish the following cases: 

Case 1): if 

\ Oisi > a s2 I a sl < a s2 

either < or < 

I oiid > «2d I Oiid < a 2d 

then, since one of the relays is 'uniformly better' than the other, we immediately see that 
d N=2 = d]v = 2 best relay , so in this regime selecting the best relay for transmission is gDoF optimal. 
Case 2): if not in Case 1, then we are in 

\ a s i > a s2 a s i < a s2 

either < or < 

I a u < ot 2d I ai d > a 2d 

Consider the case a s2 < a s \, a^ < ce 2 d (the other one is obtained essentially by swapping the 
role of the relays). This corresponds to an 'asymmetric' situation where relay 1 has the best link 
from the source but relay 2 has the best link to the destination. In this case we would like to 
exploit the inter relay communication links (which is not present in a diamond network) to create 
a route source— 7-relayl— 7-relay2— 7-destination in addition to the direct link source— ^destination. 
Indeed, in this case d^ = 2 in ( [14"] ) can be rewritten as 

^n=1 = min|max{a s2 + a ld , /3 2 + 1} ,max{l,min{a s i, a 2 4}j, ( 16 ) 



where the term max{l, min{a s i, a 2d }} in ( [16] ) corresponds to the gDoF of a virtual single-relay 
channel such that the link from the source to the "virtual relay" has SNR-exponent a s i and the 
link from the "virtual relay" to the destination has SNR-exponent a 2 d- We aim to determine the 
subset of the channel parameters a s2 < a s i, a^ < &2d for which the gDoF in ([To} is strictly 



larger than the 'best relay' gDoF in ( 15 ). The case a s2 < a s i, aid < «2d subsumes the following 
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possible orders of the channel gains: 



case i 


aid 


a2d a s2 






0t 8 \ 




case ii 


aid 


a s2 


a 2 d 




Oisl 




case iii 


aid 


a s2 






a s i 


a 2d 


case iv 




a S 2 


aid 


a 2d 


a s i 




case v 




a S 2 


aid 




a s i 


a 2d 


case vi 




a S 2 






a s i 


aid a 2 d 



We partition the set of channel parameters a S 2 < a s i, aid < a 2d as follows: 
• Sub-case 2a) (all but cases i and vi in the table above): if 



m&x{a s2 ,ai d } < min{a s i, a 2d }, 



then 



(17) 



(18) 



d 7V=2,be S t relay = Hiax{l, Q> s2 , a ld }, 

which is strictly less than d N= l in ( fT6| ) if 

either max{l, a s2 , ai d } < min{a sl , a 2 d} < max {a s2 + a ld , (3 2 + 1} 

or <^ max {a s2 + aid, 02 + 1} < min{a s i, a 2d } > fl O c 

where C>:={/3 2 = 0, a s2 + a id < 1} U {a ld = 0, 2 + l<a s2 } U {a s2 = 0, 2 + l<a M }. 
that is, for 

max{l, a s2 , ai d } < min{a s i, a 2d } except in region O. (19) 

• Sub-case 2b) (case i in the table above): if a ld < a 2d < a s2 < a s i, then the condition 

d 7v=2,best relay = max{l, a 2d } < d^ = mm j max {a s2 + ai d , f3 2 + 1} , max{l, a 2d }\ 

is never verified, i.e., in this case d^l. best relay = d 7v=2- 

• Sub-case 2c) (case vi in the table above): if a s2 < a s i < ai d < a 2d , then 

d 7V=2,best relay = Hiax{l, 0> s i} < d^ = Him | max {a s2 + a X d, 02 + 1} , Hiax{l, 0> s i} 

is never verified, i.e., in this case d^ bestrelay = d^. 
Recall that there is also a regime similar Case 2) where the role of the relays is swapped. 
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Fig. [3] gives an example of a network satisfying the conditions in ( [T7| ), i.e., the assumption is 
< y < x without loss of generality. By exploiting both relays, the system attains 

d N= l = min < max{l, x, y}, max{2x, z + 1}, max{2y, z + 1} > 

= min I max{l,x},max{2y, z + 1} >, 

while, by using only the best relay, it achieves 

max |l,min{x,y}} = max |l,y}. 

By ©, we have d£2 > dS >bestrelay if 

> max {l,y} except <z = 0,y<->. 



d (FD) 
u 7V=2,best relay 



.?.' 



(20) 



B. The Half-Duplex Case 



With HD, the gDoF is given by ( [12] ), which with the notation in ( [13] ) and with A x = A o, 
A2 = A01, A 3 = A10 and A 4 = An becomes 

dgj = max min {\ m D { ? ] + \ m D? + X 10 D? + AhD[ 3) , 

\ n(°) j_ \ nW 4. \ n (2) -l \ n (3) 



A0O-D3 + A0I-D3 + A10-D3 + All-Dg , 



)(0) L \ n'l-' 

Aoo^f + XoiDP + X W DP + An£>f}, (21) 

where the maximization is over Ay = P[Si = z, S2 = j] > 0, (i,j) G {0, l} 2 , such that 

Aoo + A01 + A10 + An = 1 and 

D[ := max {1, a 3 x,a s2 } , -Dj; = D 2 := max {1, a s i} , 

Df> := max {1, a ld , a 2d } , D\ = D£> := max {1, a s2 } , 

D 2 := max {a sl + a 2d , Pi + 1} , D 2 = D\ ' := max {1, a 2d ] , 

D\ : = max {a s2 + "id, /5 2 + 1} , -D 3 = D\ ' := max {1, a id } , 



D® = D® = D$> = D® := 1. 
For future reference, if only one relay helps the communication between the source and the 

destination then the achievable gDoF is 11251 

,„._ll+ \ njJ - 11 + 

(22) 



j( HD ) _ 1 j_ ™™ [°« ~ :L 1 + ^ id ~ :[ 1 e h <j( HD )l 



C 'iV=2,best relay — 1 + F 1 ^ 



[1:2] [a si -l]+ + [a id -l]+ 



J 7V=2J 
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An analytical closed form solution for the optimal {A^} in pi) is complex to find for general 
channel gain assignments. However, numerically it is a question of solving a LP, for which 
efficient numerical routines exist. By using Theorem [4j we can set either Aoo or An to zero. 

For the example in Fig. [3] the optimal schedule has A o = An = without loss of optimality, 
from Theorem |4j By letting Aoi = 7 G [0, 1] and A10 = 1 — 7 (recall < y < x without loss of 
generality), the gDoF in pi) can be written as 



d N= 2 = max min < 7 max{l, x} + (1 — 7) max{l, y}, (23a) 

7S[0,1] I 

7max{2x,z + l} + (l-7), (23b) 

7 + (l- 7 )max{2?/,z + l}} (23c) 

1 , • f [x - 1] + max{2y - l,z} 

= 1 + mm < - — , (23d) 

\[x- 1]+ + max{2y -l,z}-[y- l}+ 

max{2x-l,z}max{2y-l,z} \ 



max{2x — 1, z} -+- max{2y — 1, z} 



By using only the best relay as in (22), we would achieve 



d (HD) _ [x-l] + [y-l] + 

a7V=2,best relay ~ + ^ _ 1]+ + [y _ 1]+ • W) 



It can be easily seen that the best relay selection policy is strictly suboptimal if ( |20| ) is verified, 
as for the FD case. 

VI. Conclusions 

In this work we analyzed a network where a source communicates with a destination across 
a Gaussian channel. This communication is assisted by N relays operating in half-duplex mode. 
We characterized the capacity to within a constant gap by using an achievable scheme based on 
noisy network coding. We also showed that this gap may be further reduced by considering more 
structured systems, such as the diamond network. We conjectured that the optimal schedule has 
at most N + 1 active states, instead of the possible 2 N . This conjecture has been supported by the 
analytical proof in the special case of N = 2 relays and in general by numerical evaluations. We 
finally analyzed a network with N = 2 relays, and we showed under which channel conditions 
by exploiting both relays a strictly greater gDoF can be attained compared to a network where 
best-relay selection is used. 
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An interesting connection between the high-SNR approximation of the point-to-point MIMO 
capacity and the Maximum Weighted Bipartite Matching problem from graph theory has been 
discovered. 

Appendix A 
Proof of Proposition \T\ 

In a multicast network, where H r _> r = and H s _>d = in @, the rank of any channel sub 
matrix is upper bounded by 2. Thus, with Rank[H^ s ] < 2 in the cut-set bound in the step 
preceding @ and by using the NNC lower bound in (|6]), the gap becomes 

27 



f f 7 2 1 ( f 7 l*K 1 \ 
GAP < min max < 2min < — , > log max < e, > +uK log 

7>e-l/*G[0:l] [ [e /jK ) \ { 2 )) 

min < 2 min < — , — > log I emax < 1, > I +Klog 



7 



7>c-i [ [eAj \ i e 2 ) J \7 

(6)j 2log(e)i±4±^ + ^log(^g^) if^<2 



|log(f + lf)+Klog(2 + &) ifK>2 ' 

where: the equality in (a) follows since the function is always increasing in \x so the maximum 
is attained for jj° pt = 1; the minimum over 7 is attained for 



7 



l + VW2Ke [fK<2 
opt J 2 — 

1 + ^ if K > 2 



and this leads to the equality in (b). 

By substituting K = N + 2 in order to obtain the special case of the HD multi-relay diamond 
network we get ([9]). 

Appendix B 
Proof of Theorem [2] 

Let S n! k be the set of all ^-combinations of the integers in [1 : n] and V n ,k be the set of all 
A; -permutations of the integers in [1 : n]. Let a{jx) be the sign / signature of the permutation n. 

We start by demonstrating that the asymptotic behavior of |Ifc + HH H | is as that of |HH H |, 
i.e., the identity matrix can be neglected. By using the determinant Leibniz formula [|30ll , in fact 
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we have, 



|I fc + HH*| = J2 *(*)lift + HH % W 



k 



Y, <>{«) m[i k + im«] )6[i-*(i)] 



i,ir(i) 
T6P„, fe \i=2 

, n ^ 
where S[n] — < is the Kronecker delta. Let 

1 n = 

A(SNR):= J2 ^Wfn^ + H^]^))^ 1 -^ 1 )] 

B(SNR):= J2 ^)fl[^ + ™ H } iM i ) [™ H ] lMl y 

we have that A (SNR) = o (B (SNR)) , because lim B [ SNR ] = where the SNR parameterizes 
the channel gains as \hij\ 2 = SNR^ 7 ', for some non-negative fy. This is so because, as a function 
of SNR, B(SNR) grows faster than A (SNR) due to the term [HH H ] By induction it is 

possible to show that this reasoning holds \/i E [1 : k] and hence 

ii fe + hh^i = y: °w n w^ = ihh^i. 
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Therefore, now we focus on the study of |HH H |. We have 

ihhV= } y, i H f ii H fi= E i h ^i 2 



?es„ 



?G5„ 



(6) 



E 



?65„ 



e *w n ^ 



(0 



TTSPn 



i=l 



E E '(-olIiH 

E ((EnK*., 



5Ji,7ri(i) 



e ^(^ 2 ) n [ h 



? -lj>2(i) 



,126^,, 



i=i 



?eS„, *. I \7re'Pn,fc *=i 



fc k 



H f 



1 e ff ^)^^)niiWi,«(i) iL-a^,,, 

. 7ri,7r2e7 ;, ni fe,7ri^:7r2 i=l j = l 



< e e n|w,; 

k k I 

+ 1 e nnvKw.) 

.5Ti,ir26'P„ 1 fe 1 7ri7^7r2 i=l i=l 



[H 



^j^O') 



E E snrE: 



"=l[ B e]i,-n-(i) 



?6>Sn,fc I \7re'P n 






= ll a slj,TT 2 U)j 



i — 1 L •» Jz,7r(i) 



= E E snr e 

= SNR max ' e5 ™. fe max ^v n , k Ei=i[Bdi, w (i) 

where the equalities / inequalities above are due to the following facts: 

• equality (a): by applying the Cauchy-Binet formula [*30l where H f is the square matrix 
obtained from H by retaining all rows and those columns indexed by q; 

• equality (b): by applying the determinant Leibniz formula ll30l : 

• inequality (c): by applying the Cauchy-Swartz inequality OTI : 
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equality (d): when SNR — > oo, we have 

k 1 / k k \ 

5^ [B ? ] ii7r(l) > - I J2 l B ^,Mi) + Yl [ B 4> 2 (j) • 

8=1 \j=l j=l / 

Consider the following example. Let a = SNR & , b = SNR^ 6 , c = SNR ft , d = SNR & 

|a& - cd\ 2 < \a\ 2 \b\ 2 + \c\ 2 \d\ 2 + 2|o||6||c||d|. 

Now apply the gDoF formula, i.e., 

, log(|a| 2 |&| 2 + |c| 2 |rf| 2 + 2|a||&||c||d|) 

a := hm — „.,^ N 

s N r^ +00 log(l + SNR) 

jn L/ q a ,a Pa + Pb + Pc + Pd 

= max <^ f3 a + f3 b , p c + p d , 

but 

= < ^ = max {" a + ^ fe ' ^ c + &** ' 

Therefore, the term /3a+ ^^ c+/ ^ d does not contribute in characterizing the gDoF. By direct 
induction, the above reasoning may be extended to a general number of terms leading to 



z2i=l P?]j,7r(i) — 2 (^Zji=l Pc]j,7ri(i) + z2j=l P«lj, 



Appendix C 
Proof of Theorem 0] 

In a HD relay network with N = 2, we have 4 possible states that may arise with probabilities 
Xj with j e [1,4]. We let Ai = A o, A 2 = A i, A 3 = Aio and A 4 = An, where Ay = P[Si = 
h £>2 — j] > 0, (i, j) G {0, l} 2 , such that A o + A i + Aio + An = 1. Here we aim to demonstrate 
that a schedule with AooAn = is optimal, i.e., it maximizes the capacity of the HD relay 
network with N = 2. Let 

Oisi - 1 := a* x , a s2 - 1 := a* 2 , 
a ld - 1 := a* d , a 2d - 1 := «£<*■ 



The LP in (12) with the notation in (13) becomes 
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d£S = 1 + max min [XqoD^ + XoiD^ + X 1Q D^ + A Uj dJ 3) , 



where 





A n(°) j- A n (1) 4. A n (2) 4 A n (3) 

^00-^2 + A 01-^2 + ^10-^2 + ^\\ U 2 1 




a n(°) 4 a n (1) 4 a n (2) + a n (3) 

^00-^3 + ^01-^3 + ^10-^3 + Ani/ 3 , 




A0O-D4 + Aoi-D 4 + A10-D4 + A11D4 J- 


Di 0) 


= max{0, a%i,ai$ 2 } , £>i = Dy :— max {0, a* x } 


M 3) 


= max {0, a^, a^J , Df ] = Dy := max {0, a* 2 } 


^ 


= max {a* x + a 2d + 1, /?i} , _D 2 = D4 := max {0, a 2 d} 


If) 


= max {a* 2 + a* d + 1, /3 2 } , -D3 = -D4 := max {0, a\ d } 



(25) 



£><*> = L>f = £>« = Df := 0. 
Now we have to consider the different cases that may arise: 

• Case 1: max {0, a* sl , a* 2 } = -<=>- a* sl < 0, a* 2 < 0. In this case we have: 

D® = D<°> = D<°> = Df = 0, 

that is Aoo is not involved in the optimization; hence, we can set A o = without loss of 
optimality. 

• Case 2 a: a* sl > 0, a* 2 < 0. In this case we have 

d = 1 + max min { 

(A o,Aoi,Aio,Aii)e[0,l] 4 :Aoo+Aio+A i+An<l 

Aooa^i +Aoi«si +0 +0 

+0 +Ai max{a* 2 + a\ d + 1,/3 2 } +An max{0, a\ d } } ■ 

+A01 max {0, a 2d } +Ai max{0, a* d } +Anmax{0, a* d , a 2d } 

since the second constraint in ( |25] ) is always greater than the first one. 
Assume (A o, A i, Ai , An) is optimal with A o > 0; the solution (0, A o + A i, A10, An) 
gives a higher gDoF (the first and the second equations remain the same, the last one is 
increased); we reached a contradiction. Hence the optimal solution must have A o = 0. 

• Case 2 b: a* sl < 0, a* 2 > 0. As Case 2 a above but with the role of the sources swapped. 
Also in this case the optimal solution must have Aoo = 0. 
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So far we showed that if min {a* t , a* 2 } < then A o = is optimal. Due to the symmetry 
of the problem, by swapping a* sj with a* d , if min {a\ d) a 2d } < 0, then An = is optimal. 
In oder to prove our claim we must consider one last case: 

m.m{a* sl ,a* 2 } > and min {a^ d , a 2d ] > 0, (26) 

that is when all the links from the source to the relays and all links from the relays to the 
destination are strictly larger than the direct link. 



In order to prove our claim, we must partition the set of parameters in ( |26| ) into two regimes, 
say O and 0%, where in regime O we show A o = is optimal and in regime 0\ that 
An = is optimal. By the symmetry of the problem when swapping a*j with a* d , the 
regime Oq must be equal to regime 0\ when a*j and a* d are swapped. Next we show that 

O = {a* sl a* s2 > a\ d a 2d }, O x = {a* sl a* s2 < a\ d a 2d }. 

Case 3: a* x > 0,a* s2 > 0,a\ d > 0,a 2d > 0. Without loss of generality, we assume 
aid > OL2d\ in this case we have 

Df ] : = max {<, a* s2 } , £>f > = D< 0) := a* A , 

D® = D® := < 2 , D® = D® = D™ = D® := 0, 

D ( 2 l) : = max {a* sl + a* d + 1, #l} , D® = D ( 4 1] := a\ 



Df : = max « 2 + a\ d + 1, &} , D^ = L>f = £>< 3) := a\ 



c 2d> 

Now we aim to find the conditions under which setting Aoo = increases the gDoF compared 
to a case where Aoo > 0. Finding these conditions is equivalent to solve a system where 
Aoo is now split into three parts, that we name Aq 15 A* and A n . In other words, our 
aim is to demonstrate that (0, A i + Aqi, Aio + AJ , An + A* x ) gives a larger gDoF than 
(Aoo, A i, Aio, An) with A o = A^ + A* + A* x . This is equivalent to solve 

x max {a*!, a* 2 } < A^a*! + K a* 2 



xa* 2 < A* max {a* s2 + a\ d + 1, (3 2 } + A n 



a 



id 



xa* sl < Aqi max {a* sl + a 2d + 1, ft} + A n a 2d 

< Aoi«2d + Ko a ld + Kl<Xldi 
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where Aj^ + A* + \* n = x. Now, by substituting X* n = x — Aq X — A* , we obtain 

xmax {a* sl: a* s2 \ < \* Ql a* sl + \\ Q a* s2 

x (a* 2 - a\ d ) < Aio max {a* 2 + 1, /3 2 - a* d } - X^a^ 

x (a* sl - a* 2d ) < X* 01 max {a>* sl + 1, (3 l - a* 2d } - \\ a* 2d 

yk / Xa id 

A 01 S — -■ 



a id ~ a 2d 



Notice that, in the last inequality, Aq X < 1 holds if there exists a < x < 1 such that 
x < aid ~ a2d and this is always true since aid ~" 2d < 1. Assume equality in the last constraint 

— aid J a ld — ~i J 

and substitute the value of Aqi in the other inequalities. We obtain 

x * -. ^ max {g* 3l , a* 2 } a\ d - max{a* sl , a* s2 } a\ d - a* sl al d _ 

A io ^ x „.*„.* „.*„.* ~ rt ^ L! > 

\* > X ~s-z~ia ~8-z~ M ; -id-M g (2g) 

iu — r _ * i 1 o _ * t _ * r _ * i i o _ * ^ _ * 



max {a* 2 + 1, /3 2 — a\ d } oc\ d - max {a* s2 + 1, /3 2 - a\ d } a 2d 



A * < ^ max {q* d + 1, ft - Q&} o^ + a^ 2d - o£ d 2 _ = 



a ld a 2d - a 2d 



xa ld 



Ki = ; , • (30) 

"id - «2d 

Thus we should have 

max{A, B} < At , A* < C 

which is possible if max {A, B} < C. 

We notice that A < C always holds since: (i) if max {a* sl , a* s2 } = a* sl , A is always negative 

(while C is always positive); (ii) if max {a* sl , a* 2 } = a* 2 , then 

a* 2 a* ld max {a 2d + 1,0!- a* sl } + a»a > a* S 2 a id («m + x ) + ®* S 2®*si a 2d 

> a* 2 a* ld a 2d - a* sl a* d a 2d . 

Thus, our analysis reduces to find the channel conditions such that B < C. We must verify 
for which value of the channel parameters the following inequality holds 

LHS : = max {a* 2 + l,/3 2 - a* d } (max {a 2d + 1, fix - a* sl } a\ d + a* sl a 2d - a 2d 2 ) 

> a 2d ( a *s2 a ld ~ a *s2 a 2d + a ld a 2d) ='■ RHS. 
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Then the LHS of the inequality above, by using the fact that 

max {a* 2 + 1, /3 2 - a\ d } > a* s2 , 
max {a 2d + 1,0 1 - a* sl } > a* 2d , 

can be upper bounded as 

max {a* 2 + 1, (3 2 - a\ d } (max {a 2d + 1, ft - a*J a* d + a* sl a 2d - a* 2d ) 
> a* 2 (a* 2d a* ld + a* sl a* 2d - a* 2d ) =: LHS'. 
If LHS' > RHS then also LHS > RHS; therefore , 

«s2 ( a 2d a ld + a *sl a 2d ~ <Ad) > a 2d ( a *s2 a ld ~ a *s2 a 2d + a ld a 2d) 
^^ Kl a *s2 > a ld a *2d- 

Thereby, we can draw the following conclusion: assume (Aoo, Aoi, Aio, An) is optimal with 
A o > 0; as demonstrated above, the solution (0, A i + Aq 1? Ai + A* ,An + A n ) gives a 
higher gDoF; we reached a contradiction. Hence the optimal solution must have A o = 0. 
By the same reasoning, An = ^=^ <x*iCt*2 < a id a 2d- 
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Number of relays 



Fig. 1: Gap in ([5]) (solid curve) and gap in ([8]) (dashed curve) for the HD Gaussian relay 
network. The gap in ((5]) is smaller than that in (|8]) for any number of relays greater than or 

equal to 2. 
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Fig. 2: Average, minimum and maximum number of active states to characterize the capacity 

of a HD relay network. 
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id = y > o 




a s2 = y 



a 2 d = x > y 



Fig. 3: Example of a two-relay network. 
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